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ABSTRACT 



This paper describes a battery of evaluation instruments 
designed to test the language skills of limited-English-prof icient (LEP) 
elementary school students (K-6) . The battery assesses students in four 
language skills (listening, speaking, reading, writing) , uses educational 
tasks similar to those required in mainstream instruction, and reflects the 
cognitive abilities of elementary school age children. The questions of all 
tests are based on a single story, told through pictures, of a girl's first 
day at a new school. Tests include assessments for grades K-l, 2-3, and 4-6, 
and were field-tested, validated, and calibrated through a school system. A 
chart details the test titles and types and their appropriate grade levels, 
skills targeted, sub-score points, and total points. These sample tests and 
related documents are included: K-6 scoring sheet for listening and oral 
production; K-l reading test form; K-l* writing test form; teacher 
instructions for the K-l reading and writing tests; grades 2-3 reading test; 
grades 4-6 reading test; dictation answer sheet for the grades 2-3 and 4-6 
writing tests; writing prompts for grades 4-6; and scales for evaluating 
grades 2-3 writing samples. Data on test validation and test ordering 
information are appended. (MSE) 



* Reproductions supplied by EDRS are the best that can be made 

* from the original document. 



Do5^ 



Paper 

ESOL in Elementary Education 



John Nelson et al 



t-- 

<N 

t-- 

Os 

o 

'=r 

Q 

W 



Evaluating Elementary School LEP Language Skills: A Comprehensive Model 



U.S. DEPARTMENT OF EDUCATION 
Office of Educational Research and Improvement 
EDUCATIONAL RESOURCES INFORMATION 
CENTER (ERIC) 

KJ This document has been reproduced as 
* received from the person or organization 
originating it. 

□ Minor changes have been made to 
improve reproduction quality. 




ts of view or opinions stated in this 
iment do not necessarily represent 
ial OERI position or policy. 







ILE 



2 



permission to reproduce and 
disseminate this material 
HAS BEEN GRANTED BY 

k Hnn — 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC) 






John Nelson et al 



aper 



ESOL in Elementary Education 



Evaluating Elementary School LEP Language Skills: A Comprehensive Model 



School systems throughout the country evaluate LEP students in order to place 
them in appropriate instructional programs and monitor their progress through their 
educations. These evaluations typically must measure oral language proficiencies, 
literacy skills, and general academic preparation. ESOL programs seek evaluation 
instruments that can provide accurate assessment of student proficiency levels in these 
various areas which are also efficient to administer and can be used in various 
educational environments. The assessment of elementary school LEP children is further 
complicated by the various levels of general cognitive abilities expected of children 
ranging in age from 5 years to I 2 or I 3. In our school system, the need to evalualte 

LEPs’ reading and writing skills assessment even among 5 and 6 year olds is becoming 

more important. 

In response to these concerns, we have developed and plan to present a new 
battery of evaluation instruments designed specifically for elementary LEP students 
grades kindergarten through 6. Collectively the battery assesses our students in the 
four language skills, employs educational tasks commensurate with those required in 
mainstream instruction, and reflects the various cognitive levels of ability associated 
with all elementary aged students. The questions on all of the tests are based on a story 
told through pictures of a little girl’s first day at her new school. This creates student 
interest in the test and obviates the disparities in experiences and background knowledge 
among LEP students. The battery of tests includes reading and writing tests for K - I , 
2 ~ 3 and 4 - 6 grade students. The tests have been field tested, revised and validated 
with administrations throughout our school system. Cut-off points for progression 
through our program and exiting our program are based on test scores from both LEP 
students and mainstream, English-speaking students. 

Our presentation will introduce this battery of tests, outline the processes of 
test development and validation, and discuss the results of using the battery for student 

placement and promotion in our ESOL program. Samples of the tests will be shown to 

the audience. 
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Prince George’s County’s 
New Elementary ESOL Test: 

6 Grades - 4 Skills 

THE STORY OF ANA 

Our new test battery is designed to cover 3 variables among our 
students: English proficiency , grade level and literacy skil l. Our 
presentation will feature the test and discuss the significance of grade 
level literacy objectives for elementary ESOL teachers. 



TESOL PRESENTATION 
March 15, 1997 

Agenda 

1. Overview of theTest Battery and Listening and Oral Production Tests : 

John Nelson, Prince George’s Co. Schools 

2. The K - 1 Reading and Writing Tests: 

Rosemary Snowiing, Prince George’s Co. Schools 

3. The 2-3 and 4-6 Reading Tests : 

Chris Gimpel, Prince George’s Co. Schools 

4. The 2i3 and 4^6 Dictation Tests and Writing Prompts 

Carol Bartley, Prince George’s Co. Schools 

5. Validation Process for the Test Battery and Statistics : 

Randy Hansen, University of Maryland, Baltimore County 
& Prince George’s County Schools 

6. Discussion of Literacy Skills Ownership : what literacy skills should be 

taught by the ESOL teacher and what literacy skills should 
be left to mainstream instruction? 



The Story of Ana Test Battery 



Test Title 


Grade 

Levels 


Target Skills 


Sub 

Points 


Total 

Points 


Listening Test 


K - 6 


Listening comprehension 




20 


Oral Production Test 


K - 6 


Speaking and grammar 




20 



K - 1 Reading Test K - 1 


Letter recognition 


5 






Number recognition 


5 






Word recognition 


5 






Sentence reading 


5 


20 


K - 1 Writing Test K - 1 


Name writing 


5 






Letter dictation 


5 






Word dictation 


5 






Sentence writing 


5 


20 



2-3 Reading Test 


2-3 


Reading comprehension 




20 


2-3 Dictation Test 


2-3 


Sentence completion 




20 


2-3 Writing Prompt 


2-3 


Writing correct English 
Writing coherently and 


10 








progressively 


10 


20 



4 - 6 Reading Test 


4-6 


Reading comprehension 


10 








Vocabulary comprehension 


10 


20 


4 - 6 Dictation Test 


4-6 


Sentence completion 




20 


4-6 Writing Prompt 


4-6 


Writing correct English 
Writing coherently and 


10 








progressively 


10 


20 

■ 
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The Story of Ana 

ESOL Elementary Listening and Oral Production Tests 

K - 6 Score Sheet 

Student’s Name Date 

Age Grade Native Language Schooi 



Listenina 


Oral Production 


Picture #1 
1 . 


Singular/Plural 

1 . 


2. 


2. 






Picture #2 
3. 


Negative Verb BE 
3. 


4. 


4. 






Picture #3 

■s 


Present Continuous Tense 
5. 


r* 


6. 






Picture #4 
7. 


Neg. Verb DO/Prep. Phrase 
7. 


8 . 


a. 






Picture #5 
9.' 


Prep. Phrase/Object Proncun 
9. 


10. 


10 . 







Listenina 


Oral Production 


Picture #6 
11. 


Common Questions ' 

11. 


12 . 


12 . 






Picture # 7 
13. 


Questions with Verb CO 
13.’ 


14. 


14. 






Picture #8 
15. 


Comparative/Sucenadve 

15. 


16. 


16. 






Picture #9 
17. 


Past Tense 
17. 


18. 


18. 






Picture #10 
19. 


Past Tense/Present Tense 
19. 


20. 


20. 







Listening Test Score Oral Production Test Score 

Comments: 




Test<g: 



ESOL Reading Test K - 1 



Scots 



Name School __ Qatg 



A 


B 


c 


D 


E 


N 


Q_ 


G S 


K 




a 


b 


c 


r 


t 


h 


i d 


p g 


W 


/5cm 


i 


2 


3 


s 


6 


q 


4 10 


16 


27 


_/Sp« 


cal - 


- man - 


hat 






bat - sa 


l 

cr 

o 

■"< 






hit 


- s, 


□m 


- it 


— 


get 


~ and - 


■ in - 


set 


fStn 


Ana 


is a 


3' rl 


. She 


is 


going 


to school 


1 

. Sbe. 


plays 


ball. 


Sam 


has 


a book. 




Pat < 


ond Ana 


are friends. 


_j5?n 



ESOL Writing Test K - 1 



Name; 



Score 



— ' /5 pts 

Latters & Numbers: 



pts 

Words: 



" ‘ /5 pts 

Sentence: *' * 
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6S0L ELEMENTARY WRITING TEST GRADES 2 - 3 
DICTATION ANSWER SHEET 



1 . Ana is 

2. She is going to a 

3. Tne students are sitting 

4. Ana sits 

3. Ana's ESOL class is 

3. At recess. Ana wanted to play jump rope 

7. At lunch time, Pat and Ana 

3. After school. Ana came home 

9. Ana told her mother that she had 

1 0. Now Ana is 



1. Ana is a girl. 

2. She is going to a new school . 

3. The students are sitting on the floor . 

4. Ana sits next to Sam . 

5. Ana’s ESOL class is very small . 

6. At recess, Ana wanted to play jump rope with Pat 

7. At lunch time, Pat and Ana ate together 

3. After school, Ana came home bv bus . 

9. Ana told her mother that she had nice friends 

10. Now Ana is very hanov . 



ESOL ELEMENTARY WRITING TEST GRADES 4-3 
DICTATION ANSWER SHEET 

1. Ana 

2. She is 

3. Ana is a new student, but . 

4. Ana and Sam sit beside each other. They 

5. Ana goes to ESOL class because she 

6. At recess time, the children played 

7. Ana and Pat 

3. After school , Ana rede 

9. Ana told her mother that she 

10. Ana 



1 . Ana is a girl . 

2. She is going to school . 

3. Ana is a new student, but Sam isn't. 

4. Ana and Sam sit beside each other. They fikg to talk . 

5. Ana goes to ESOL class because she doesn't soeak Eng, 

6. At recess time, the children played a lot of games 

7. Ana and Pat alg their lunch 

8. After school. Ana rode home on the hi is 




school. 



9. Ana told her mother that she was very hannv 

10. Ana likes her new sohnni 
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Validating our Tests 
Correlation Coefficients 



On this page are the results of correlation studies we have done to validate the 
results of our tests. To make the correlation, we asked teachers to evaluate their 
students in the skills that are measured by these tests. Some 10 ESOL teachers each 
made evaluations of their students’ listening, oral production, reading and writing 
skills. The teachers were asked to evaluate ten students for each level of our tests, k- 
1 , 2-3,' and 4-6. Their evaluations were compared to the actual test scores that their 
students earned on the tests at the end of the last academic year. 

This year, we returned to the schools where four of these comparisons were 
made to retest as many of the students at these schools as we could. These retests 
were compared to both the test scores from last spring and the teacher evaluations 
made last spring. It is felt that high correlations between the test scores and the 
teacher evaluations and high correlations between the test scores and the retest 
scores would be indications of test validity. 

The results of these correlations are presented in the four boxes below. To 
interpret the numbers, perfect correlations would be 1 .000. This would mean that 
every test score exactly coincided with every teacher evaluation in every situation. 

The close these numbers approach 1 .000, the better the correlation and, therefore, the 
more validity the tests would appear to have. 



Correlations between the SPRING TEST SCORES 
and the FALL TEST SCORES 



Reading 
Writing Diet. 
Writing Prompt 



K-1 Tests 2 -3 Tests 4- 6 Tests 



.8630 


.8866 


.8519 


.8027 


.9831 


.8519 


n/a 


.4969 


.6031 



Correlations between the SPRING TEST SCORES 
and the TEACHER EVALUATIONS 

K-1 Tests 2 - 3 Tests 4-6Tests 



Listening 


.6078 


.5671 


.6471 


Oral Production 


.71 28 


.7116 


.8513 


Reading 


.6122 


.7043 


.7838 


Writing Diet. 


.6569 


.7021 


.7693 


Writing Prompt 


n/a 


.4937 


.3395 



Correlations between the FALL TEST SCORES 
and the TEACHER EVALUATIONS 





K - 1 Tests 


2 - 3 Tests 


4 - 6 T ests 


Reading 


.6643 


.6801 


.7797 


Writing Diet. 


.6239 


.3087 


.7861 . 


Writing Prompt 


n/a 


.3552 


.6729 



The Ana Test Battery is available for sale to the public. 

The Test Set includes THE STORY OF ANA test booklet containing the 
pictures of the test story and the quetions for the Listening and Oral 
Production Tests, and THE STORY OF ANA TESTERS’ HANDBOOK 
containing all of the tests in the battery with explanatory notes and 
scoring guides. The cost is $20.00. 

To purchase a copy, contact: 

Mrs. Carol O’Brien 
c/o Prince George’s C.o Public 
Schools’ ESOL Program, 

8908 Riggs Road, 

Adelphi, Maryland, 20783 
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